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Abstract 



In earlier simulation studies of educational systems usually Markov chains are used 
(i.e. simulation in which history plays no role since all events are described 
independent of each other) or mono-level system dynamics (i.e. a simulation of 
how learning takes place ignoring the social context in which it occurs). 
Educational theories, however, are usually multilevel in their nature, since they 
describe pupil learning amongst others as a function of characteristics of the group 
in which this learning takes place. Moreover, teacher behaviour is affected by 
organizational interventions. A three-level simulation model for educational 
effectiveness (3LS) will be presented. The model adequately describes the 
functioning of standard setting by teachers, which can be seen as the lever for 
raising performance levels. Experiments with the model show that it is almost 
impossible to achieve different (possibly conflicting?) policy goals simultaneously. 
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Foreword 



At the end of the eighties educational science made a step forward by a theoretical 
and a statistical innovation. The theoretical innovation was the educational 
effectiveness programme. As Coleman (1989, 2) stated it: 

"Without this shift, the hard questions would have remained: Which school 
inputs make for differences in outputs? What difference does the school a 
child goes to make in the child's achievement? How much do schools 
overcome the inequalities with which children come to school? One might 
wonder why educationai researchers had not asked these questions iong 
ago. why they had not always focused on outputs of schoois in assessing 
their quality. (...) Researchers characteristically do not study the 
effectiveness of teachers by measuring what teachers do and comparing 
their activities to what children learn. Instead, they carefully study what 
teachers do but seldom examine what their students learn. (...) Beginning 
with the publication of the Equality of Educational Opportunity report, the 
first hurdle was cleared and schools' effectiveness could be measured by 
the performance of their students. " 

The statistical innovation was the introduction of the multi-level statistical model 
that made it possible to test educational hypotheses on, e.g., teacher effects on 
pupil achievement, while more adequately modeling the hierarchical nature (pupils 
nested within teachers) of the data. Uptil this point the conclusion could have been 
no other than (Cronbach, 1976, 3); 

"The majority of studies of educational effects - whether classroom 
experiments, or evaluations of programs, or surveys - have collected and 
analysed data in ways that conceal more than they reveal. The established 
methods have generated false conclusions in many studies". 

The theoretical and statistical improvement makes it possible and worthwhile to 
study educational phenomena from a multi-level perspective. Thinking throi^h the 



implications of the hierarchical and sequential nature of educational systems, 
however, now forced by the theories that try to link organizational and instructional 
characteristics with pupil behaviour, and trying to formulate these ideas in a multi- 
level precise fashion shows the shortcomings of mental nwdels. Therefore in this 
report an attempt is made to formulate such a model in mathematical terms, and 
then using the computer to run simulations and study the behaviour of this model. 
This report then tries to explore two things at the same time: the possibilities of 
constructing a simulation nwdel of educational effects, and the use of such a 
model in forecasting the effects of new educational policies. 

The model is a completely redesigned version of the simulation programme 
outlined in Bosker et al. (1988). The programme written in Pascal is included in the 
appendix to this report. For those who study this report to find out the possible 
working of the new Common Core Curriculum ("de Basisvorming") or the 
Educational Priority Programme ("het OnderwijsVoorrangsBeleid") a cautionary 
note IS in place: the forecasted effects are only true in so far as the simulation 
model IS valid For those who study the simulation model the cautionary note is: 
the effects forecasted by the model are only true in so far as our translation of the 
policies into scenarios is valid. 

One thing is for sure: the conceptualization and mathematical formulation of the 
model forces us to explicit assumptions and theoretical propositions which helps in 
finding gaps in the theory and gaps in the empirical justification of this theory. As 
far as we are concerned: this is only the beginning. 

Henk Guldemond was responsible for programming the simulation nwdel (see the 
appendix), while the remainder of this repoh was written by Roel Bosker. 
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Chapter 1 : Introduction 



Understanding social systems is hindered by their ovenwhelming complexity. 
Understanding possible effects of changes in these systems is even more difficult. 
It is for this reason that comparative education is a useful discipline within the 
educational sciences, although using insights in the structure and working of a 
foreign educational system often is impeded by the specific societal and cultural 
conditions under which such a system functions. Understanding the impact of 
innovations that have no parallel in other countries is even more complicated. The 
feasibility of ex ante evaluation of two major policies that are in effect at the same 
time depends on the rationality of these policies. If there exist clear goals, and 
complete information on means and ends is available evaluation can be restricted 
to a logical analysis. But of course, this is hardly ever the case. The situation even 
deteriorates when there are more goals to be achieved at the same time. Mental 
models of causes and effects certainly fall short here. This exactly is the situation 
in the Netherlands, where two major policy programmes are aimed at improving 
the functioning of secondary education. The introduction of a Common Core 
Curriculum aims at improving excellence and efficiency, whereas the Educational 
Priority Programme tries to reduce inequality of educational opportunities. 

It is for these reasons that in this report an attempt is made to evaluate these 
innovations beforehand by using a simulation model, based on a combination of 
two interdisciplinary theories (general systems theory and rational choice theory) 
and two educational theories (the Carroll model of instructional effectiveness and 
the school effectiveness nx)del). 

The attempt to be made in this report is a precise formulation of these educational 
theories, then restating the rrwdel in mathematical terms, validating it, and then 
using it for prospective purposes deriving specific hypotheses on effects of the two 
beforementioned policy programmes in the end. 

In the sequel of this report a multilevel simulation model of education will be 
introduced, as an aid to forecast the consequences of policy interventions. Therefor 
the following steps will be made: 
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1 . problem definition 

2. system conceptualization 

3. model representation 

4. model evaluation 

5. evaluating alternative scenarios for policy intervention. 

The report starts with an outline of the Dutch educational system, the Common 
Core Curriculum, and the Educational Priority Programme (chapter 2). Then 
simulation as a tool of forecasting is discussed in chapter 3, illustrating the 
technique with appiications in the field of educational science. System 
conceptualization departing from the rational choice approach to the explanation of 
compositional effects in education as proposed by De Vos (1986, 1989) is dealt 
with in chapter 4. Chapter 5 focuses on the mathematical formulation of the rrxjdel, 
and chapter 6 contains some empirical research aimed at validating the model. In 
chapter 7 then, the Common Core Curriculum and the Educational Priority 
Programme are formulated as three alternative scenarios, that are then evaluated 
using the simulation modei. Finally, chapter 8 summarizes the main results, offers 
some specific hypotheses to be tested in empirical research, and highlights the 
main directions for a more refined simulation model. 
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Chapter 2: Defining the problem 



The Dutch system for secondary education is categorical: at the age of thirteen 
pupils have to decide what type of school is most suited to the individual pupils’ 
aims and cognitive capacities. Generally speaking they have four options (ranked 
in increasing difficulties); 

1) JVE (LBO); junior vocational education (duration: four years), 

2) IGSE (MAVO): intermediate general secondary education (duration: four years), 

3) HGSE (HAVO): higher general secondary education (duration: five years), 

4) PUE (VWO); pre-university education (duration: six years). 

Switches between the schoottypes are possible before or after acquiring a 
certificate. 

This secondary school system has at least five distinct disadvantages. The first and 
main problem is that choices between the four main streams (JVE, IGSE, HGSE, 
and PUE) are actually made when the pupil is twelve years old, despite the one- 
year orientation period in secondary education, intended for selection and deter- 
mination purposes. The reason is qurte clear; most schools fo^ secondary 
education are categorical: choosing to follow your orientation period at a HGSE 
school implies with almost 100% certair.ty a HGSE scfiool career. This means that 
the pattern of the school career for about four years is determined by a choice 
made at the end of primary education The selection of pupils when they are aged 
12 is far too early. As a consequence, pupil background variables bear a strong 
relationship to choice of school career. This relatior,ship is much stronger than 
might be expected judging by differences in intellectual abilities (cf. Tesser, 1984). 
The second problem is, that the degree of flexibility in the system is below 
expectation. As already mentioned, switches between the main streams are 
possible. A downward switch, however, is most likely: it happens to one out of ten 
children and is five times more likely than an upward switch after completing the 
first stream chosen (Sociaal Cuttureel Planbureau, 1982). Although comprehensive 
schools were introduced, offering two or three categorical streams as an option to 
increase the flexibility of the system, their success has been below expectation for 
the more able pupils (cf. Kreft, 1987): pupils in categorical PUE schools seem to 
be better off than equally able pupils in comprehensive schools. Furthermore, the 



curriculum track chosen one (JVE and IGSE) or two years (HGSE and PUE) 
before completing secondary education, strongly determines the possible choices 
for further education in colleges, senior vocational education and so on. As a result 
of not choosing mathematics and science subjects at school, girls have a more 
limited range of possibilities than boys. The third problem is that curricular contents 
are very different in the vocational and general stream: gaining a broad cultural 
and scientific knowledge is the privilege of children in the general streams, 
whereas the vocational schools concentrate on learning practical skills for the job 
market. The fourth problem is, that, because of the fourfold division in Dutch 
secondary schools, pupils with different backgrounds are usually completely 
separated from each other. Social integration is thus limited after a secondary 
school is chosen. The fifth and last problem is, that many pupils never gain a 
school-leaving or final exam certificate. Ten percent of all pupils drop out of the 
system before completing school. 

After many plans were unfolded to solve these problems, eventually public support 
was given to a plan not aimed at restructuring the old system into a horizontal one. 
but introducing common achievement norms. The essential idea of this plan is that 
all secondary schools have the same basic curriculum in the first three 
comprehensive years of secondary education, with 14 subject areas and a 
common achievement level. The main differentiation principle should be such as to 
allow some pu>^ ils to reach the standards within a shorter period, and allowing 
other pupils to reach the standards in four years when necessary. In this way, the 
educational level of all pupils should increase. Besides this, the correlation 
between background variables and school career should decline. This is also the 
objective of the Educational Priority Programme, that mainly focuses on improving 
opportunities for disadvantaged pupils in primary schools. Resources, however, are 
also made available to regions where there is a high concentration of lower class 
and/or ethnic minority pupils. In a collaborative effort primary schools, social 
agences, and secondary schools then will try to improve the educational 
opportunities of these pupils. In 1993 the first schools will begin to implement the 
characteristics of the Common Core Curriculum. The study described in the sequel 
of this report explores the possible outcomes of this innovation. Our main objective 
is to study whether it is possible to achieve three goals at the same time; 



increasing the overall achievement level, improving the efficiency of the system, 
and decreasing inequality of opportunities in education. 



Chapter 3: About simulation 



Education as a social system is very complex. Geurts (1983) describes this 
complexity in four domains: 

1. multivariate complexity: social phenomena are caused by many causal forces at 
the same time 

2. multilevel complexity: individuals, groups, and other social entities constitute 
larger social connections and they are in their turn influenced by these 

3. muttirelatiorial complexity : relations between parts of a social system can take 
on various forms, like unidirectional causation, reciprocal causation, and 
feedback-loops 

4. timecomplexity: social systems develop over time and do not have same 
patterns of behaviour at various points in time 

Although it is possible to construct mental models of social systems, these models 
are inadequate to understand the complex dynamic properties of these systems. 
For this reason the construction of formal models may be of help, since these are 
clear and verifiable and easily to manipulate. 

By presenting three examples of simulation as a tool to study educational 
phenomena, the basic principles, advantages and shortcomings of this technique 
can be demonstrated. 

3.1 Boudon’s dynamic lEO model 

Anderson’s paradox is the point of departure for Boudon to study inequality in 
education and society. This paradox is the empirical observation that the 
correlation between a son’s social status and his educational level relative to the 
father’s is low. This fact seemed to contradict the idea of industrialized societies 
becoming more and more meritocratic. Although this problem deals with inequality 
of social opportunity Boudon’s work is of relevance for us here since he formulated 
a partial model to explain inequality of educational opportunity (lEO for short). 
Boudon (1974, 67-68) strived for a dynamic model in the sense that he wanted to 
simulate the school careers of a school cohort of pupils, i.e. the careers of a set of 
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youngsters who attend the last grade of elementary school at some time. Next to 
this Boudon aimed at a system-dynamic model, i.e. a model that would allow to 
predict the differences between different school cohorts. 

We will confine ourselves to present the main features of Boudon's lEO model, by 
simply presenting only the 6 most important of his eight auxiliary axioms: 

1. There are three social classes called C1 (high), C2 (middle), and C3 (low); 

2. At any time 10,000 Cl youngsters, 30,000 C2 youngsters, and 60,000 C3 
youngsters will finish elementary education; 

3. There are three achievement levels, R1 (high), R2 (middle), and R3 (low); 

4. Social class is related to achievement according to the following table: 

Table 3.1 ; The relation between social class and achievement 





R1 


R2 


R3 


C1 


60% 


30% 


10% 


C2 


50% 


30% 


20% 


C3 


30% 


40% 


30% 



5. The educational system can be simplified as a higher curriculum versus 
dropping out. At eight points in his career a pupil has to choose between 
staying in the higher curriculum or not. By definition this implies that there are 
9 distinct educational levels. The chances to survive for a given social class 
and achievement level are: 
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Table 3.2; Survival probabilities as a function of social class and achievement 





R1 


R2 


R3 


Cl 


.85 


.75 


.65 


C2 


.70 


.60 


.40 


CO 

O 


.60 


.40 


.20 



6. Survival probabilities (p) increase over time (t) according to: 

Pu. = Pt + (1-P,)-10 

The last axiom is presented to construct a model in which new generations of 
youngsters in a society tend to choose the higher curriculum more often then 
preceding generations. The specific form of the formula imposes a ceiling effect on 
this phenomenon. The formalization introduced by Boudon is very simple, but 
nevertheless some simple empirical facts can be reproduced by this model. To 
start with the proportion of upper class pupils surviving at a branching point relative 
to the proportion of lower class pupils increases with the level of education (e.g. 
this disparity index is higher at the 6th branching point than at the 5th). The well 
known disparity index for the college level for some countries (18) can be readily 
reproduced by the rrx 3 del, the index meaning that a higher class pupil has a 
chance that is 18 times higher than that of a lower class pupil to survive in the 
higher curriculum untill college. 

By modifying auxiliary axiom 4, stating that social class has no relation to 
achievement (i.e. for all social classes the distribution over achievement levels is 
60%, 30% and 10%), Boudon found that the disparity rate only reduced to 10. 
Stated otherwise: class-specific selection and choice-processes are more important 
than class-specific achievement differences in explaining lEO. 

More important, however, are the dynamic properties of the model, i.e. the 
changes in lEO when comparing several school cohorts and allowing for a (small) 
increase in the probabilities to survive at each branching point. Although at each 
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branching point lower class pupils will have a greater increase in these probabilities 
than higher class pupils (as a consequence of the ceiling effect imposed on the 
model by auxiliary axiom 6), the amount of lEO will hardly decrease. Moreover, the 
amount of decrease in lEO will slow down over time. As compared to the 
described situations, the disparity index for the college level will have been 
improved from 18 to 10 after four cycles, but it still shows an enormous amount of 
lEO. Given Boudon’s parametrization the number of pupils attending college will 
have been doubled (from 6% to 12% of the pupil population) after four cycles. Or 
to combine these two observations; the more developed the educational system, 
the weaker is lEO. Boudon's general conclusion, however, is that as long as 
stratification exists either in society or in education or in both lEO will be the 
consequence. Survival probabilities for lower class pupils can be altered by altering 
expected utilities of choosing the higher curriculum, which is a complex task. In a 
critique on the distinction between primary effects (via achievement) and the 
secondary effects (via the survival probabilities) of social stratification. Bosker 
(1990. 13) contends that the relation between social class and achievement may 
change (become stronger) as a school cohort of pupils advances in its careers. 
Then the secondary effects might be purely on artefact of the model as it is 
constructed by the axioms. Nevertheless, Boudon’s approach showed that it was 
possible to study a complex social phenomenon like lEO more detailed by 
simulation techniques. 



3.2 The structure of studertMeacher Interactions 

Combining research on self-esteem, standards, expectations, student ability, and 
instructions Levin & Roberts (1976) cons»ructed with the help of DYNAMO 
(developed by Forrester to forecast industrial development: see Roberts et al., 
1983) a modnl of student-teacher interaction. Although the model seems quite 
complex simplicity can be found in the metrics used: time and performance units. 
Figure 3.1 shows the model in a systems graph. 
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Figure 3.1; Systems diagram of student-teacher interaction as it affects 
classroom performance 

The model speaks for itself, so to speak. The authors summarize the model as 
follows (Levin & Roberts, 1976, 99): 

"In review, during the course of a school year, a child adjusts his goals so 
they are in line with his performance. The gap between how well a child is 
performing and how he would like to perform determines the amount of 
teacher help the child thinks he needs. This in turn influences the amount 
of help the student seeks, which affects the amount of time and help the 
teacher gives the student. This help, combined with the student’s innate 
potential and current store of knowledge, influences his rate of learning. 
Learning rate increases as the student’s knowledge base increases. This 
knowledge accumulation will then determine the student’s performance. (...) 



-4s they have been described, each of the two main modeled feedback 
loops can lead cyclic fluctuations in student performance, accompanied 
by fluctuations aiso in student goals and teacher objectives, in help-seeking 
and help-giving, and in student rate of learning. The student and teacher 
are clearly shown as affecting each other, with student performance being 
the joint product. 

Each nx)deled loop also reflects the processes whereby goals or objectives 
shift to accommodate short-term performance. Through these changes over 
time either the student or the teacher or both can turn off the help- 
seeking/help-giving interchange that so critically influences the dynamics of 
performance. " 

Notice that the model contains a negative feedback-loop staicture: it is a goal- 
seeking system. The lower the performance the level, the more time is allocated, 
the better the performance, the less time is allocated, etc. Another important 
feature, not shown by the graph, is the delay in response that Levin & Roberts 
build into the model: it may take some time, for example before a teacher 
perceives a gain in performance level. Conceptually the model focuses on what 
might be called the "learning gap": the discrepancy between ability and 
achievement and/or the discrepancy between standards (goals) and achievement. 
Since we will elaborate on this idea in chapter 4 one table presented by the 
authors on the outcomes is of particular interest: 

Table 3.3: Performance under different specifications of the model 



teacher 

expectations 


student 

goals 


student performance 
time 
10 h/w 


time 
20 h/w 


75 


80 


75.5 


76.2 


75 


95 


76.0 


77.0 


95 


80 


76.8 


78.0 


95 


95 


82.0 


84.8 
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Time (measured in hours per week) is not so much important as is teacher 
expectations and student goals, (given the parametrization chosen by the authors). 
A problem with this model, however, is that the context of learning (classrooms and 
schools) is totally ignored. This condition, as Barr & Dreeben have demonstrated 
(1983), is vital in understanding school learning. 



3.3 A system perspective on effective schools 

Clause! & Gaynor (1982) tried to construct a model to conceptualize the basic idea 
"that schools are systems that produce multiplier effects (that is, they reinforce 
initial patterns of achievement)" (Clauset & Gaynor, 1982, 55). As with the Levin & 
Roberts’ model the point of departure is the interaction between instruction and 
learning conceived as a negative feedback loop (oscillating goal-seeking 
behaviour). The systems graph underlying the model (that once again was build 
using DYNAMO) is presented in figure 3.2. 
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Figure 3.2: A dyrtamic theory of schooling. 



The authors explain the background of this model as follows (Clauset & Gaynor, 
1982 , 55 ): 



"In an effective school, teachers and the principal maintain high 
expectations of the achievement of all but the clearly exceptional student. 
They assume that, regardless of family, background or social class 
characteristics, all children can learn at a normal rate and can achieve 
standard (or better) levels of performance during their schooling. In an 
ineffective school, expectations for achievement are neither high nor fixed. 
Children who enter school with a lower level of reading readiness or who 
are from lower socioeconomic classes are categorized as low achievers 
(Rist, 1973). It is assumed that there is little the school can do to offset the 
impact of preschool, family, and environmental conditions. 

This feedback relationship involving achievement, expectations, and 
instruction is the backbone of our dynamic theory of schooling. " 
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The conclusions drawn after running the model lead to the following conclusions: 

1 Interventions should focus on raising teacher expectations; 

2. Maximize time for instnjction. 

This last conclusion could also be drawn from the Levin & Roberts' model, 
although they argue that standards are far more important. As with Levin & 
Roberts the condition of schooling (Bidwell & Kasarda, 1980) plays no role. 
Although class- and schoollevel variables are included in the model, actually it is 
run as a mono-level, i.e. a pupil-level, model, assuming that the behaviour of other 
pupils in the classroom has no effect on the process. 
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Chapter 4: System conceptualization 



In order to forecast the consequences of the innovation outlined in chapter 2, first 
of all a conceptualization of secondary schooling has to be accomplished. This is 
done by applying the elements of the well known Carroll model and using a model 
developed by De Vos (1989), based on the interdisciplinary theory of rational 
choice. It integrates pupil learning, instruction and school organization models. By 
means of this model, the progress pupils make in schools as a result of their prior 
cognitive abilities, the heterogeneity of the instructed group, the standards that 
teachers set for pupils and the time available for individual help can be simulated. 
The simulation will be hierarchically, longitudinally organized reflecting key features 
of educational organizations: the nesting of pupils in classes, the nesting of classes 
in schools, the dependency of adjacent grades by those pupils who repeat a grade, 
the dependency of adjacent curricular tracks by those pupils who drop out of one 
track to proceed in the next lower one. 

The most dynamic process in education is pupil learning. The mono-level 
background of the multilevel theory is the well-known Carroll model of instruction. 
A simplified form is depicted in figure 4.1. 
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Figure 4.1: The key-variables of the Carroll model (Carroll, 1989). 



This scheme is used in mastery learning. It does not have, however, the multilevel 
character of learning and instruction. Standards that teachers hold for pupils as 
well as the allocated learning time are constrained not only by pupil but also by 
group characteristics. Ability grouping research, for instance, indicates that ^pupils 
learn less in a low achieving group than in a high achieving group and, moreover, 
that initial low achieving pupils differ more in learning from high achieving pupils in 
honxjgeneous than in heterogeous grouping (Gamoran, 1986; Dar & Resh, 1986; 
Guldemond et a!., 1989; De Vos, 1989). 

Research on ability grouping (Dar & Resh, 1986) suggests ttiat pupil ability within 
a class affects the standards as well as the instructional quantity. An educational 
effects model should therefore incorporate non-recursion. Learning and instruction 
can then be depicted as in figure 4.2 (i.e. two-way causation, as in feedback 
relationships). 
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Figure 4.2: The non-recursive relation between teacher’s standards and pupil 

achievement. 

Average achievement of class j at timepoint t (A,,) thus affects the standard set by 
the teacher for the next period of teaching (S,,). Prior achievement of pupil i in 
class j at tirriepoint t (A,,|), the standard, and the interaction between the two lead to 
an increase in achievement (A,,,,), etc. This mechanism may explain the sizeable 
effects of group level aggregates of pupil variables, next to the effects of the pupil 
variables themselves, on pupil achievement, as they are generally found in school 
effects research. Hauser (1974) has contended that these effects can be merely 
demonstrated if the pupil level model is underspecified (i.e. does not contain all 
individual level variables that could account for achievement differences). Kreft 
(1987) has argued that the reverse may also be true; individual variables may be 
shown to have an effect since the group level model is underspecificied. 

The principle that can explain these factors is the gap between the actual 
performance of the pupil and the standard. The larger the gap the less utility a 
pupil is expecting of learning. This idea is simulated with success in the mono-level 
studies presented in chapter 3. In the sequel we will present a multi-level approach 
to model these phenomena. 

The conceptualization is derived from De Vos' model of composition effects in 
education (De Vos, 1989). As with Boudon, De Vos starts with the rational choice 
approach, stating that pupils strive for social approval from the teacher, such as 
support and grades. Teachers also strive for social approval from parents and 
colleagues. As with the DYNAMO-models of Levin & Roberts and Clauset & 



O 



19 f.' r 

^ t » 



Gaynor, standards play a key role. Conceptually the empirical basis for giving this 
concept a central place in the model can be found in school effectiveness 
research, where time and again (c.f. Scheerens, 1992) "press to achieve" turns out 
to be one of the central elements in the effectiveness enhancing school 
organization. The implication of standards are simple: a high standard means 
giving lower grades for the same achievement level, setting a faster pace, and 
disapproving longer with pupils’ performance levels. Now combining teacher and 
pupil behaviour De Vos summarizes the central proportions as follows (De Vos, 
1989, 228); 

“1. students’ marginal utility for achievement is dependent on teachers' 
evaluations and is highest at teachers' standards; 

2. teachers' standards are dependent on the average achievement level of 
the class or ability group: 

3. students in the same class or group are confronted with the same 
standards and therefore have the same marginal utility function of 
achievement and: 

4. the marginal cost function of students depends on their individual ability 
and therefore varies between students." 

The connections between pupil, class and teacher run as follows. The higher the 
average achievement level, the higher the standard. Giving a certain performance 
level pupils have cost utility considerations, that lead to a net utility (approval 
versus efforts) corrected for the subjective probability of goal attainment. In Its turn 
this subjective probability is higher as the pupil has more succesfull fellow pupils. 
This last idea is borrowed from social comparison theory. 

With his model De Vos is able to explain the sizeable effects of average group 
characteristics. Although we will not dwell on It in the formulatation of the model, a 
nice feature of De Vos’ model is that It forecasts differential composition effects 
that are actually described in the literature. This forecast is based on figure 4.3. 
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Figure 4.3: differential composition effects 

De Vos explains the differential effects by referring to the graph (De Vos, 1989, 
229 (erratum versiori)): 

"a. Marginal cost functions of low-ability (MC) and high-ability (MCJ students 
in d low average achievement class (marginal utility function MU^ i.e. a low 
standard). Low-ability students achieve at level P in a low average 
achievement class. High-ability students achieve at level Q in a low 
average achievement class and at level S in a high average achievement 
class; 

b. Same as a., but with a teacher in the low average achievement class who 
gives t.he (relatively) high achieving students he has, more approval at the 
cost of students who achieve at and around his standard. The effect of this 
teacher strategy is that MU, has a long right tail and a tower maximum. 
Now the difference between the achievement levels of high- and tow- 
ability students in a high average achievement class (OS - OR) is smaller 
than in a tow average achievement class (OO • OP)." 
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De Vos contends that higher standards lead to more pace. In this respect it seems 
worthwhile to introduce allocated time as a variable to the model, to capture the 
second main aspect of the Caroll model. Except for empirical research (c.f. 
Walberg & Friser, 1989), that demonstrated relevant and malleable effects of this 
instructional variable, we also are in the position to model differential teacher 
effects without modifying the uniform standard held for all pupils of a class. 

The complexity that is not yet in the model can be described as the Frisian 
paradox, the concept stemming from a Dutch joke on Frisians (people residing in a 
Dutch province striving for independence) and Belgiums (as known the 
neighbours); what happens when a Frisian nnoves to Belgium? Mean IQ in the 
Netherlands as well as in Belgium will raise! This phenomenon will occur if we 
allow for adjacent grades, adjacent curricular tracks, and adjacent school cohorts. 
When demotion from the standard reaches a maximum a pupil will repeat a grade, 
drop out or switch to a lower curricular track. Now this change does not only affect 
the class of pupils he leaves (and by this also the standard the teacher will set) but 
also the class of pupils he then enters. Exactly this complexity calls for a 
simulation. 
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Chapter 5: Model representation 



The general conceptualization outlined in chapter 4 will be given a more 
operational, mathematical form in this chapter. First of all we have to choose 
system boundaries. We assume to study a categorical education system with four 
curricular tracks with varying degrees of difficulty. Furthermore this system is 
restricted to four grades. These restrictions are a simplification of the Dutch 
education system described in chapter 2. We will not study comprehensive 
schools, since once the pupil is assigned to a curricular track it can be known how 
achievement levels are distributed over the tracks where pupils started their career 
directly after leaving primary school. The limitation to four grades has two reasons. 
First of all the innovation that we want to study, concerns this part of secondary 
schooling. Moreover, the interconnections between the lOur tracks become very 
loose after the fourth grade with other tracks (mainly in senior vocational 
education) being a realistic alternative for pupils opting for change. Another 
restriction imposed on the model is, that only one class per grade per cohort per 
school will be studied. Since we study a categorical system it is no loss of 
generality to assume that classes within a school (for a certain grade grade and 
cohort) would have equal distributions on the variables of interest. The last 
assumption is that achievement is onedimensional, which ofcourse ignores the 
many subjects taught in secondary education. Achievement in the model m.ight be 
thought of as averaging over the subjects of the curriculum. 

Learning gain is defined in the model as a function of attributes of the pupil (IQ, 
socio-economic status and a performance rating made by the teachers of the 
primary school), the standard a teacher sets for his class, available instruction time 
and chance (random fluctuation, or stated otherwise: effects of variables that are 
not in the model). First of all the standard is set as a function of the mean 
achievement level of the class. The reason for this is. that standards set too high 
may work demotivating, and they only function for the pupil as a normative 
reference point if they are near the actual performance level. According to 
comparative reference theory (Richer, 1976) this standard can be seen only as a 
positively motivating striving point if the pupil sees other classmates functioning 
near the standard. In heterogeneous classes this will be more likely than in 




homogeneous classes. This is the notion associated with De Vos’ model 
concerning the subjective probability of goal attainment. Heterogeneity has been 
demonstrated to have such a positive elect in secondary education (De Vries. 
1992). Formali 2 ed: 

( 1 ) STANDARD,^: = 0.5 SD(ACHIEV),^ + MEAN(ACHIEV),^ 



The standard a teacher sets for his class is the mean achievement level plus half 
of a standard deviation of the achievement in his class. 

Next to the standard the degree of over- or underachievement is a determinant of 
learning gain The degree of overachievement is measured by comparing a pupil’s 
actual performance level with his predicted performance level, where the prediction 
is based on socio-economic status. IQ. sex and the teacher rating at the end of 
primary education. 

The standard procedure to accomplish this is by regressing achievement on the 
background attributes: 



(2) ACHIEV., = Bo„ + (3,SES„, + B^IQ,,, + B 3 RATING,,, + B,SEX.„ + e,„ 



(3) e,,, = observed(ACHIEV,|,>) - predicted(ACHIEH,|J 

The residual for pupil i in class j in school k then simply is our measure of 
overachievement. This variable will further be referred to as RESIDUAL, 

The next step concerns the degree to which a pupil will make an effort to 
accomplish learning gain. Following the rational choice models of Boudon (1974) 
and De Vos (1989) this effort is dependent on a cost-benefit analysis made by the 
pupil. The effect of socio-economic status is explained by these authors by 
different equilibrium points for the different social strata. 



The equilibrium points are defined as 



(4a) EQUIL.^ := MEAN(ACHIEV),, for low SES pupils 

(4b) EQUIL,,,: = 0.5(STANDARD,k - MEAN(ACHIEV),J for middle class pupils 

(4c) EQUIL,,,: = STANDARD,, for high SES pupils 

Taking into account the definition of the standard in (1) low SES pupils reach their 
equilibrium point half a standard deviation below the standard, middle class pupils 
a quarter below the standard, and high SES pupils at the standard set by the 
teacher. 

From (3) and (4a) through (4c) we can derive two possible situations; pupils who 
do not have (yet) reached their equilibrium point (I; RESIDUAL,,, < EQUIL,,,) and 
pupils who did accomplish this already (II: RESIDUAL,,, > EQUIL,,,). 

Situation I: without loss of generality it can be assumed that the equilibrium point 
for a certain SES-group is 0. Furthermore the residuals can be rescaled to z- 
scores. 

(5) ACHIEV;, = ACHIEV;;’ + (•;4™:^v((1'V'27T)e '^‘'‘’^})*RANDOM(O..SD(ACHIEV),J 

The first part of (5) that needs explanation is the integration part. This is the 
surface under the standard normal distribution between the actual achievement 
level of a pupil and his equilibrium point. Since 1 minus this surface is used, the 
difference for two pupils with small differences in actual performance level? but 
near their equilibrium point is smaller than for two pupils with the same small 
differences in school performance levels but further away from their equilibrium 
point. By taking this into account we have succeeded in formal modelling the fact 
that pupils near their equilibrium point have a greater chance of making progress, 
whereas being further away may lead to demotivation. 



The second part of (5) that needs explanation is the RANDOM-part. The progress 
a pupil makes is to a certain degree unpredictable. RANDOM(O..SD(ACHIEV)|J 
should be read as: pick a random number between 0 and SD(ACHIEV)|,,. Since 
heterogeneity is part ot this function pupils in heterogeneous groups have a greater 
chance of making more progress. This reflects the idea of comparative reference 
processes: pupils in heterogeneous groups see classmates functioning near their 
equilibrium point as positively motivating examples: In other words, the subjective 
expectation of goal attainment increases as the distance to the equilibrium point 
decreases as well as when classmates function near the equilibrium point. 

Situation II: 

(6) ACHIEV;, = ACHIEV;;’ + RANDOM(O..SD(ACHIEV),J - 0.5 SD(ACHIEV),, 

For pupils that have already reached their equilibrium points and that are not 
achieving below expectation the mean progress is exactly zero, since the mean ot 
RANDOM(O..SD(ACHIEV),J is equal to 0.5SD(ACHIEV),;,. 

Instructional quantity is the next factor to be modelled. An increase of it leads to 
more learning gain, but its marginal effects decreases rapidly (the difference 
between using 10% or 20% of the available time for instruction has greater effects 
on learning gain than, say, between 80% or 90%). 

For a class j the time actually used for instruction is defined as the percentage of 
the time available: 

(7) T| := RANDOM(10..100) 

By introducing a log-function the marginal effects of instructional quantity on 
learning gain can be modelled. Again, like before, the situation is different for 
pupils below and above their equilibrium points: 

Situation I: 
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(8) ACHIEV; = ACHIEV:;i + 

+ (log{T,)/iog(55))*(1-/|°;^l^v{{1/^27i)e'=''’‘''^})*RANDOM{O..SD(ACHIEV),J 
Situation II: 

(9) ACHIEV;^ = ACHIEV;;^ + 

+ (log(T,)/log(55))*(RANDOM(O..SD(ACHlEV),J - 0.5 SD(ACH1EV),J 

Mean learning gain in the population is not affected by introducing instructional 
quantity into the model, but differences between schools in learning gain are now 
introduced. 

Selection effects (i.e. that some schools get better pupils than other schools) are 
simply introduced as follows: 

(10) newACHIEV,,, = oldACHIEV,,^ + 8,, 

where we have pupil i of generation j in school k. Furthermore: 

(11) (3,, = u„ + u, 
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in which u,^ ~ (0,0.05) and u^ ~ (0,0.1) with var(ACHIEV,|J = 1. 

This way between schools differences in initial achievement levels make up 10 
percent of the total variation in initial achievement, and the generation effects 
within schools are 5 percent (that these figures are realistic is shown in Bosker & 
Guldemond, 1990). It should be noted that in the actual simulations with the model 
specification 4 was simplified with the equilibrium point chosen for all pupils at the 
Low SES specification. Furthermore was assumed to be zero (no mean 
differences between different school cohorts in the same school at entrance). 

So far the model formulation has restricted itself to two levels: the pupil and the 
classroom. By combining adjacent grades within a school, and by introducing the 
possibility of a switch of curricular trade the school and educational system level 
can be introduced. This is done by four definitions: 
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a) repeating a grade := (STANDARDjk - ACHIEV,,J > 2SD(ACHIEV),^ 

or in words: a pupil repeats a grade when his achievement level lags more than 
two standard deviations behind the standard set by the teacher. By repeating a 
grade the pupil becomes part of a class of a younger generation of pupils, and the 
pupil will of course enter this class with his last reached performance level. 
Moreover, by leaving his original class, the teacher can set a higher standard for 
the rest of the pupils (by definition). 

b) a switch from a higher curricular track to a lower one: repeating a grade twice 
within two years. 

Consequently, the pupil switches to the next grade of a lower curricular track. 

c) drop out: repeating a grade within two years in the vocational track because the 
pupil cannot be referred to another curricular track. 

d) a switch from a lower curricular track to a higher one: 

ACH,,,, = Mean (ACH„.„„,„) 

When pupiU in school k of a generation j in curricular track c performs up to the 
level of a younger generation (j-1) in a higher curricular track, he will switch from 
one curricular track to the other. 

A systems graph of the simulation model for educational effects is depicted in 
figure 5.1 
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Figure 5.1 ; A three-level systems dynamics model of pupil achievement 

The hierarchical structure has been solved by declaring queues which are linked 
(the programming is done in PASCAL). Learning progress is modelled as an S- 
shape function of prior achievement, background characteristics, standards, group 
heterogeneity and quantity of instruction. Grades are interconnected by those 
pupils who repeat a grade; tracks are interconnected by those pupils who switch 
track: pupils are interconnected by the group they are in; classes are 
interconnected by the school they are in. 

The objects in the simulation are 4,137 students from a cohort study conducted by 
the National Bureau for Statistics. These students are assigned in 4 generations to 
85 secondary schools in the simulation. A technical detail is that first of ail the 
simulation starts with treating 4 generations of students to 'fili' the system before 
the simuiation actually starts. The variables defined on the students are the 
following: 
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RATING: A score ranging form 1 (apt for individualized junior vocational education) 
to 13 (apt for pre-university education) 

SEX: Coded as 0 for boys and 1 for girls 

SES: This is derived form the mean of four indicators: occupational and 
educational level of both parents. The coding for the educational level is: 

1 . primay education not completed 

2. idem, completed 

3. first stage of secondary education (certificate for JVE (LBO) or IGSE 
(MAVO) or completed grade 3 in HGSE (HAVO) or PUE (VWO)) 

4. second stage of secondary education (certificate for HGSE or PUE or 
completed grade 3 in senior vocational education) 

5. first stage of higher education (completed firts stage in unversity or 
completed a vocational college) 

6. second stage of higher education (completed university^ 

The coding for occupational level is: 

1 .5. worker, employee (low level) 

3.0. farmer, small business man 

4.5. employee (middle level) 

6.0. professions; higher employee 

SES is then recoded into three categories. 

ACHIEV: Continuous variable with arbritary distribution that develops over time (the 
initial score is derived from a test taken by the National Institute for Educatina! 
Measurement) at entry to secondary education. At later stages the outcome of the 
simulation is used. 

IQ: Continuous variable with arbitrary distribution (the so called PSB-test) 

TRACK: The assignment of students to one of the four tracks is directly based on 
information from the cohort-data. 
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POSITION: This variable describes the position a pupil holds at several timepoints 
in his schoolcareer. In the analysis we will only work with the the position at entry 
(START POSITION) and after fours years of schooling: FINAL POSITION. This 
variable is one of the outcomes of the simulation. The coding is based on the 
grade the pupil may enter, i.e. if he succesfully has finished JVE-grade-4 the 
coding is based on being virtually in JVE-grade-5. It is coded as 3: JVE-grade-1 ; 4: 
JVE-grade-2 or IGSE-grade-1 ; 5: JVE-grade-3, IGSE-grade-2 or HGSE-grade-1 ; 6: 
JVE-grade-4, IGSE-grade-3, HGSE-grade-2 or PU E-grade- 1 ; 7: IGSE-grade-4, 
HGSE-grade-3 or PUE-grade-2; 8: HGSE-grade-4 or PUE-grade-3; 9: HGSE- 
grade-5 or PUE-grade-4; 10: PUE-grade-5. 
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Chapter 6; Model evaluation 



By assessing the validity of the model, the outcomes as produced by the 
simulation will be compared with results from empirical research. As far 
correlations are concerned, the outcomes will be compared with data available on 
an earlier cohort of pupils in secondary education (the so called SMVO’-cohort). A 
drawback of this comparison is, that in this cohort no achievement data other than 
at entry are available. 

Table 6.1; Comparison of the outcomes of the simulation with (between brackets) 
earlier data (a national cohort of 1976) 





IQ 


old Ach. 


SES 


FINA 


IQ 

old ACHIEV 
SES 

FINAL POSTION 


1.00 

.31 (.48) 
.12 (.16) 
.34 (.38) 


1 00 

.35 (.26) 
.75 (.70) 


1.00 

.38 (.27) 


1.00 



Comparison of the two series of correlations show some differences, but most of 
these have to do with that part that enter the simulation model as 'givens’. The 
output of the model (FINAL POSTION), however, correlates almost as strong with 
the background variables as the output measure in the empirical data. Only SES 
has a somewhat stronger relationship with FINAL POSITION, but this is mainly 
caused by the difference in the other correlations (the partial correlation between 
SES and FINAL POSITION is .19 for the simulation and .14 for the empirical data, 
with oldACHIEV partialled out). 



To find out how good the model predicts achievement differences the data can be 
compared with a Dutch national assessment study carried out in 1989 (Kremers. 
1990). This study demonstrated that within curricular tracks socio-economic status 
was not related to achievement in mathematics, biology, dutch language, and 
english language. 
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Table 6.2: Achievement broken down by socio-economic status and curricular track 





mean 


s.d. 


n 


JVE (LBO) 


ses low 


107.06 


8.69 


126 


ses middle 


109.37 


8.99 


232 


ses high 


116.13 


13.16 


19 


IGSE (MAVO) 


ses low 


119.51 


5.07 


37 


ses middle 


121.07 


7.62 


247 


ses high 


122.46 


7.72 


69 


HGSE (HAVO) 


ses low 


126.19 


2.50 


6 


ses middle 


126.92 


4.53 


129 


ses high 


129.55 


4.86 


66 


PUE (VWO) 


ses low 


138.10 


5.50 


7 


ses middle 


133.10 


6.48 


63 


ses high 


133.53 


7.53 


63 



The results, based on a 25% random sample of the pupils that had been ’treated' 
by the simulated education system, indicate that the model indeed is able to 
reproduce an achievement distribution that varies across the curricular tracks, but 
hardly across the three socio-economic status groups within curricular tracks. The 
outstanding scores of low SES pupils in the PUE-track, and vice versa of high SES 
pupils in the JVE-track, are not significant differing from the scores of the other 
pupils in these tracks. The differences between the socio-economic groups in the 
IGSE- and HGSE-track are significant, but nevertheless very small. The model 
results indicate that the disparity index for the two higher curricular tracks is 8: a 
pupil from the higher socio-economic status families has a probability of being in 
one of the two rrxjst prestigious tracks that is 8 times as high as that of a pupil with 
lower socio-economic status. 



The results then are satisfying, and for the time being, we consider the model as a 
valid representation of secondary schooling. 



Chapter 7: Evaluating different scenarios 



7.1 Defining the scenarios 

The common core curriculum as well as the introduction of common achievement 
norms especially aim at the students in the lower curricukar tracks, i.e. junior 
vocational (JVE) education and intermediate general education (IGSE). This 
scenario then might be interpreted as raising standards in these two tracks. In the 
simulation model this scenario is formalized as follows; 

STANDARD,, = MEAN(ACHIEV),, + 0.75*SD(ACHIEV),, 

(for students in the JVE-track) 

STANDARD,, = MEAN(ACHIEV),, + 0.60*SD(ACHIEV),, 

(for students in the IGSE-track) 

Another approach to raise performance levels is to spend extra instruction time on 
low achieving students, i.e. students that lag far behind the standard set by the 
teacher. In this scenario instructional time is unevenly distributed over the students 
of a class, under the condition that the total time spent on instruction by the 
teacher remains the same. Applying principles of simple linear programming (in 
other words; applying calcalus) then leads to the following formalization; T,, / 
classsize is the mean instructional time to be spent on each student. Each student 
receives at least 10% of the time available for instruction. The total time available 
for individualized instruction is; n, * T,, in which n, represents classsize, with U,, = 
n, * T,. Each student at least receives 10%/n, individual instruction. If T, equals 10% 
there is no time left for additional instruction. For T, > 10% the following rules are 
applied; students performing at or above the standard do not receive extra 
instruction; for students performing below the standard the instructional time is 
given by; 

T, = t,(STANDARD„ - ACHIEV,,,) 



in which the t’s are chosen within the boundary restrictions. 



The last scenario to be evaluated aims at improving the achievement levels of low 
SES students. This is an extention of the second scenario by spending twice as 
much time on low SES students performing below the standard than on the other 
students performing below the standard. Then if SES’ is a dummy variable (1 : low 
SES: 0; middle class and high SES) we can formalize this by: 

T, = T,, (STANDARD,, - ACHIEV,„) + T2,(SES’*(STANDARD„ - ACHIEV,,,)) 

under the condition that T 2 = 2 *t,, with Xj being the coefficient fo.r low SES students 
and X, for the other students. With x being the coefficient for the average student x,, 
can be found by the next equation: 

t = [n,, * T,, + ( 02 , * 2 * T,,)] / [n,. + nj,] 

in which n,, is the number of low SES students perfomiing below the standard and 
n,. are the other students performing below the standard. 

7.2 Assessing the effects 

In evaluating the effects of the three alternative scenario’s against the present 
situation a hierarchical linear model (Bryk & Raudenbush, 1992) will be used in 
which SES is the pupil level variable of interest (a factor with three categories, that 
shows up in the analysis as two dummies), and scenario is the variable of interest 
at the school level, with four categories (rearranged into three dummies). 
Moreover, the hypothesised differental effects of the scenarios for pupils with 
different socio-economic backgrounds imply that the interaction between scenario 
and SES is also in the model as a crossoroduct (6 dummies). Since the simulation 
was constructed in such a way that for each scenario exactly the same pupils with 
the same characteristics enter the education system, controlling for IQ, SEX, 
RATING, TRACK, and initial ACHIEV is already achieved at. 

Because of software limitations the statistical analysis is restricted to a 25% 
random sample of pupils from the simulation. 

The distribution of the three dependent variables as a function of the four scenarios 
is depicted in table 7.1 . 



O 



41 



36 




Table 7.1; Breakdown of achievement, educational level, and efficiency by scenario 







achievement 


educational 1. 


efficiency 






mean 


s.d. 


mean 


S.d. 


mean s.d. 


scenario 


1 


119.63 


11.72 


7.44 


1.50 


85.47 22.82 




2 


120.96 


12.08 


7.43 


1.56 


84.19 22.22 




3 


113.56 


9.60 


7.38 


1.56 


83.83 23.50 




4 


110.22 


10.29 


7.21 


1.55 


79.73 26.52 


Total 




116.24 


11.83 


7.37 


1.54 


83.38 23.85 



The results of the simulation as presented in table 7.1 indicate that the effects to 
be expected by the three alternative interpretations of the Common Core 
Curriculum innovation are very modest (and negative) as tar educational level and 
efficiency are concerned. With respect to achievement the results indicate that as 
with respect to the scenarios where only some pupils (those far below the standard 
in scenario 3, and only tor low SES pupils scoring far below the standard in 
scenario 4) will benefit from extra instruction, overall achievement levels will 
decline, and the variance in achievement will decrease. Since the distribution of 
pupils over educational levels is a relative process (as a consequence of repeating 
a grade, promotion, drop out, etc. being processes dependent on relative group- 
dependent rather than absolute standards) this does not affect the general 
educational level achieved on average, nor the efficiency of the school career in 
secondary education. To get a first idea of the effects ot the scenarios on 
inequality ot educational opportunities, the results are broken down by socio- 
economic status in table 7.2 
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Table 7.2: Breakdown of achievement, educational level, and efficiency by 
scenario and socio-economic status 



achievement educational I. efficiency 





mean 


s.d.i 


mean 


s.d. 


mean 


S.d. 


scenario 1 


SES low 


1 1 1 .56 


11.13 


6.38 


1.39 


75.11 


26.55 


SES middle 


119.28 


11.02 


7.43 


1.40 


86.68 


22.09 


SES high 


127.27 


9.38 


8.29 


1.29 


90.14 


19.06 


scenario 2 


SES low 


114.97 


10.90 


6.55 


1.54 


76.73 


25.80 


SES middle 


119.28 


11.74 


7.30 


1.48 


83.45 


22.21 


SES high 


127.83 


10.71 


8.36 


1.34 


91.29 


17.21 


scenario 3 


SES low 


106.69 


7.59 


6.23 


1.38 


73.09 


26.78 


SES middle 


1 1 2.88 


8.92 


7.30 


1.45 


83.65 


23.48 


SES high 


120.64 


8.33 


8.46 


1.30 


92.27 


16.78 


scenario 4 


SES low 


106.42 


8.51 


7.00 


1.09 


87.88 


19.72 


SES middle 


109.25 


10.14 


7.01 


1.57 


76.80 


28.28 


SES high 


115.81 


9.79 


7.93 


1.61 


81.57 


24.63 



Scenario 2 (raising standards in JVE (LBO) and IGSE (MAVO)) nor scenario 3 
(extra instruction for those pupils lagging far behind) hardly have any effect on 
inequality of educational opportunities. Only scenario 4, where the original 
achievement gap between low and high SES pupils of 16 points has been reduced 
to 9 points, seems successful! in this respect. As we have seen before, however, 
this seems to be possible because of a general decline in achievement. 

A multilevel statistical test of the effects of the scenarios on student achievement, 
final educational position, and efficiency are depicted in table 7.3. 
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Table 7.3: Test of the effects of four different scenarios 





achievement 


educational 1. 


efficiency 




effect 


s.e. 


effect 


S.e, 


effect s.e. 


intercept 


119.26 




7.44 




81.23 


scenario 1 


0.00 


0.00 


0.00 


0.00 


0.00 0.00 


2 


1.22 


1.73 


-0.01 


0.07 


-2.08 2.99 


3 


-5.79 


1.76 


-0.06 


0.07 


-1.46 3.02 


4 


-8.02 


1.71 


-0.22 


0.07 


-6.50 2.95 



The results of the statistical tests clearly indicate that the fourth scenario has 
significant negative effects on all three outcome variables. As for the third scenario, 
this only has significant negative effects on achievement. The explanation of these 
negative effects is that giving extra instruction to low achieving pupils leads to less 
gain for the other pupils, and thus to lower standards on average, and thus to less 
gain, etc. In scenario 4 especially middle and high SES pupils that show a large 
gap to the standard might be the victims of not getting enough instnjctional time 
allocated to them, this resulting in repeating grades, and drop out. Whether or not 
this indeed is the case can be seen in table 7.4 where the differential effects of the 
scenarios are put to the test. 
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Table 7.4: Test ot the differential effects of the four different scenarios 



achievement educational I. efficiency 





effect 


s.e. 


effect 


S.e. 


effect 


S.e. 


intercept 


117.54 




6.92 




74.37 




ses 1 


0.00 


0.00 


0.00 


0.00 


0.00 


0.00 


2 


1.42 


0.51 


0.31 


0.07 


8.13 


1.83 


3 


3.94 


0.65 


0.35 


0.09 


9.14 


2.31 


scen2*ses2 


-1.55 


0.74 


-0.23 


0.11 


-5.65 


2.65 


scen2*ses3 


-2.15 


0.92 


-0.07 


0.14 


-2.58 


3.30 


scen3*ses2 


-0.22 


0.74 


-0.01 


0.11 


-2.78 


2.65 


scen3*ses3 


-1.72 


0.93 


0.13 


0.14 


1.06 


3.32 


scen4*ses2 


-2.06 


0.73 


-0.64 


0.11 


-19.''3 


2.63 


scen4*ses3 


-3.87 


0.91 


-0.52 


0.13 


■18.18 


3.26 


scenario 1 


0.00 


0.00 


0.00 


0.00 


0.00 


0.00 


2 


2.69 


1.79 


0.04 


0.26 


2.04 


3.62 


3 


-5.27 


1.82 


-0.11 


0.27 


0.06 


3.64 


4 


-5.95 


1.77 


0.34 


0.26 


9.32 


3.58 



With respect to achievement we see that the second scenario (a higher standard in 
the two lowest curricular tracks) leads to a narrowing of the gap between the ■ ocio- 
economic status groups as existent under the present situation (no change in 
policy). This might be the case because low SES pupils are overrepresented in the 
JVE- and IGSE-tracks. On the positive side we find also the result that this 
scenario leads to less inequality with respect to the education levels attained, 
although low SES pupils still lag significantly behind high SES pupils. 

The third scenario (extra instructional time for those pupils that lag behind) has no 
significant effects on inequality of educational opportunities, but on the whole it 
leads to a drastic decline in the performance levels. The fourth scenario (extra 
instructional time for low SES pupils lagging behind) leads to a significant reduction 
of inequality, but this is achieved not so much by improving the performance levels 
of low SES pupils, but by a decline in performance levels of high SES pupils. 




Chapter 8: Discussion 



In earlier simulation studies of educational systems usually Markov chains are used 
(i.e. simulation in which history plays no role since all events are described 
independent of each other) or mono-level system dynamics (i.e. a simulation of 
how learning takes place ignoring the social context in which it occurs). 
Educational theories, however, are usually multilevel in their nature, since they 
describe pupil learning amongst others as a function of characteristics of the group 
in which this learning takes place. Moreover, teacher behaviour is affected by 
organizational interventions. A three-level simulation model for educational 
effectiveness (3LS) was presented. Pupils for the simulation (i.e. objects and their 
scores on the variables) were sampled from the VOCL database (the CBS-VOCL 
database contains data on a cohort of approximately 20.000 pupils in 400 
secondary schools). The model is based on a theory of De Vos (1989) that focuses 
on the central role of standard setting by teachers, which can be seen as the lever 
for raising performance levels. The model provides a good description of how 
schools work in terms of predictive validity. One part of future research is in finding 
out the sensitivities of the model, and in validating the model using actual data 
(achievement and final position) on the cohort pupils that are available now. 

Four scenarios were evaluated using the model; the present situation, and three 
alternative interpretations of the effects of the Common Core Curriculum that 
schools will implement starting in 1993. 

Increasing standards in the lower curricular tracks does not have (significant) 
effects on the improvement of achievement nor on the final position of the pupils. 
The scenarios with disproportional assignment of instructional time to students 
performing below the standard lead to a decrease in achievement (in both 
scenarios) and to a decrease in the final position in the last scenario (extra time for 
low SES students). Following the logic of the model the explanation could be that 
the progress of low achieveing students can not compensate for the relative lack of 
progress high performing students demonstrate. This then leads to a small 
decrease in the mean achievement level, such as that students at the bottom of 
the achievement distribution will not repeat grades (since their distance to the 




standard, which is derivated from the mean achievement level, is not large 
enough). If they do repeat a grade, however, their absolute achievement level is so 
poor that do not even have a positive impact on the class that they are referred to. 

Under all but the last scenario (that had negative overall effects) inequality of 
educational opportunities is not soived. To some degree raising standards in the 
lower curricular tracks seems to produce the most promising results, not with 
respect to the excellence goals but with respect to equity. The gap between low 
and high SES pupils will become half of what it is in the present situation. An 
important result for the evaluation of the Common Core Curriculum and the 
Educational Priority Programme is, thaii the effects of these innovations will be very 
small, indicating that the research design chosen and implemented should 
maximize power; large samples, reliable achievement tests, reliable indices of 
socio-economic status, etc. 

Until now the simulation model is used to do experiments with standards, track 
placement, and instructional time. Future directions are concerned with the 
inclusion of new instructional as well as organizational interventions next to the 
already implemented constraint intervention of maximum class size. These 
interventions concern constraints on standards for all teachers within the school 
and constraints on instructional quantity (cf. Barr & Dreeben, 1983). Another 
modification will concern the inclusion of comprehensive schools in the nrxDdel, i.e. 
two curricular tracks that are combined. This will have effect on heterogeneity, and 
thus on social reference processes. One of the advantages of using simulation 
models is, that the mathematical formulation forces us to be precise on the 
relations between the variables. This then may lead to the acknowledgement that 
there are black holes in our knowledge of education, and thus the formalization 
helps in guiding future empirical research. 

Real intervention studies, using true experimental designs, can hardly be done in 
educational research because of difficulties in assigning pupils to conditions at 
random and also because of the difficulty of implementing the complex 
inten/entions we are dealing with when we wish to implement organizational and 



instructional "treatments". True experimentation then is quite near to impossible in 
educational settings, if the various layers of school organizations are to be 
considered simultaneously. Therefore the approach presented in this report may be 
an alternative to this dilemma. When the theory is formalized, experiments can be 
carried out by computer simulation. In this way computer simulation can be used 
as a surrogate for empirical experimental intervention studies. 

Experiments with the rrwdel show that it is almost impossible to achieve different 
(possibly conflicting?) policy goals simultaneously. For this reason the system 
dynamics approach should be combined with operations research, i.c. decision 
theory: finding decision rules (for instance concerning track placement of pupils) 
that optimize the three goals (excellence, equity, and efficiency) simultaneously. 
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Appendix: source code of 3LS (3*Levei Simulation model of Educational 



progreun 31s( infile , outfile , input , output ,beta ); 

{* const max = 5 : there are five pupil variables involved 
in the regression equation; max can be raised to ten 
without changing anything in the program. Variables should 
be presented in free-format in the file named infile. 

The first max variables are those that are entered into the 
regression equation. Variable no. 1 is the dependent 
variable. There may be no missing data. Variable no. 2 is 
SES (socio-economic status) scored as low# medium, high. This 
variable in this position is important if one wishes to wor)c 
met more than one standard (see Procedure Process!!). Variables 
read into the progr^un are either integers or reals . 

Procedure ''residuals” is written in capitals to indicate that 
it uses external procedures defined in henX.tpu 



next : )cind ; 
nep : boolean ; 
doubleer : boolean ; 
mer)cte)cen : boolean ; 
leerjaren : integer; 

nummer : integer; 

aanvang : integer; 

svtoud : real ; 

tij : real 



end; 

queue anchor ; 

anchor s record 
school : integer ; 

lichting : integer; (* for times a new generation per school 



uj)c , u)c : real; 

standaard, stdev, gemiddelde ; real ; 

eljr : integer ; (* schooltype and grade *) 

length : integer ; 

first , last : kind ; 

tj t real ; (* instruction time *) 

end; 

rij s array [1. .Max] of real ; 



Effectiveness) 



•) 



Const maxx ^ 10 ; 



max = S ; 
maxi = 1000000; 



var expno : integer; 



( * expno = experiment number 

0 = regular run 

1 s higher standards in Ibo and mavo 

2 = unequal Instruction time 

3 s as 2 but now with extra instruction 



time for low SES pupils 

*) 



type 



realarraynp array[l. .Maxx] of real; 
integerarraynp = array [1 .. Maxx] of integer ; 
mat = array [1. .Maxx, 1. .Maxx] of real ; 
kind = ^rec; 



rec = record 

11 : array [1 . .Max] of :eal ; 

typ ; integer ; ( * career in schooltypes * ) 

resid : real ; (* residual score regression equation *) 

Ljr : integer; (^ career in grades *) 

eljr: integer; (* schooltype and grade at this moment *) 



This is to have bjk = ujk * uk in the 
model. With each new generation ujk 
is randomly taken, wheras uk is constant 
over the four generations 
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var ••nkind , vorigkind : kind ; 

var hulpquaua, target queue, z it queue , 

queuelbo,queueaavo,queuehavo,queuevwo : queue ; 
i/j : integer ; 
infiles text ; 
out file: text ; 
beta s text ; 
teller s integer ; 
schnr : integer ; 
regels : integer ; 

gemidde Iden : array [ 1 . . 4 , 1 . . 4 ] Of real ; 
totaal s integer ; 
indxx s integerarraynp; 
col s realarraynp; 
dd s real ; 

trapzdit s integer ; 
zittenblij vers : integer ; 
ran3inext, ranSinextp : integer; 
ran3ma : array [1..55] Of real; 
gasdeviset : integer; 

gasdevgset : real ; 
idum : integer; 
echt : integer; 
xyz sarray [0. .45]Of integer; 

procedure wledan( q sqpieue); 
var k : kind; 

i : int eger ; 
begin 

for i := 0 to 45 do xyzLi]:=0; 
k := q'^. First; 
while ( k <> nil ) do 
begin 

if (k'^.Nep = false) then xyz [k'" .Bljr] : =xyz (k^ .Kljr] + 1 
k : = k . Next ; 
end; 

for i:= 0 to 45 do 
writeln(i:4, ' = xyz [i]: 10); 
end; 

function tellen( qsqueue ):integer; 
var k : kind ; 

aantal : integer; 
begin 

aantal : = 0 ; 
k := q-^. First; 
while ( k <> nil ) do 
begin 

(*if ( k^.Nep = false ) then *) aantal := aantal + 1 ; 

k := k^.Next; 
end; 

tellen aantal ; 
end; 
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function ran3 ( var Idum : Intagar ) : r«al; 

const 

mblg = 4.0E6; 
mseed = 1618033.0; 

Mz =; 0.0; 

Fac = 2.5B-7; 



var 

i, 11, k : Integer; 
mj , mk : real ; 




begin 

If Iduzn < 0 then begin 
mj := mseed Idum ; 
if mj >= 0.0 Then 

mj : = m j - mblg * trunc (mj /mblg) 
else 

mj ; = mblg - abs(mj) + mblg • trunc ( abs ( mj ) / mblg) 
ran3ma[55] := mj ; 
mk : = 1 ; 

for 1 := 1 to 54 do begin 
11 := 21 • 1 mod 55 ; 
ran3ma[ll] mk; 
mk : = m j ~ mk ; 

If mk < mz then mk : = mk mblg; 
m j ; s ran3ma [11] ; 

end; 

for k := 1 to 4 do begin 
for 1 := 1 to 55 do begin 

ran3ma[l] := ran3ma[l] - r^aI3ma[l + (1 + 30 ) rood 55 ]; 
If ran3ma[l] < mz then ran3ma[l] := ran3ma[l] ^ mblg 
end 
end; 

ran31next :=0 ; 
ran31nextp := 31 ; 
idum : = 1 
end; 

ran31next := ran31next 1 ; 

If ran31next s 56 then 
ran31next 1; 

ran31nextp := ran31nextp 1 ; 

If ran31nextp s 56 then ran31nextp := 1; 
mj :s ran3roa [ ran3 Inext 1 - ran3ma [ran31nextp] ; 
if mj < mz then mj ; = m j + mblg; 
ran3ma [ran3 Inext ] : = mj ; 

ran3 : = m j • fac 
end; 




function gasdev ( var id\un : integer) : -real; 



var 

fac, r, vl, v2 : real ; 



begin 

if gasdevlset = 0 then begin 
repeat 

vl ; = 2.0 * Ran3 ( idum 
V2 ;= 2.0 * Ran3( idum 
R := sqr( vl ) + sqr 
until ( r < 1.0 ) And ( r 
Fac := sqrt( -2.0 * Ln{ r 
gasdevgset := vl * fac; 
gasdev := v2 * fac; 
gasdevlset := 1 

end 

else begin 

gasdevlset 0 ; 
gasdev : = gasdevgset ; 

end 

end; 



) - 1 . 0 ; 
) - 1 . 0 ; 
v2 ) ; 

> 0.0 ) ; 
)/r ); 




BEST COPY AVAILABLE 
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procedure ludcir^(v«r a: mat; n: integer; 

var indx; integerarraynp; var d: real); 



const 

tinysl .OE-20; 

var 

k,j,lmax,l: integer; 
sum, dum^big : real; 
w T ^realarraynp; 

begin 

new(w) ; 

for i : = 1 to maxx do w^[i) := 0 ; 

d := 1.0; 

For i : s 1 to n do begin 
big : ss 0.0; 

For j : = 1 to n do 

if (aibs (a [ i, j 1 ) > big) then big ;= abs(a[i,j)); 
if (big = 0.0) Then begin 

writeln( 'pause in ludcir^ - singular matrix'); 
end; 

w^[i) := 1.0/Big 

end; 

for j ;= 1 to n do begin 
for i ;= 1 to j-1 do begin 
sum : = a [ i , j ) ; 

for k := 1 to i-1 do 

sum := sum-a I i, )c) *a [k, j ] ; 
a [i, j 3 : = sura 

end; 

big : = 0.0; 

For i : = j to n do begin 
sum : = a [ i , j ] ; 

for k := 1 to j-1 do 
sum := sum-a [i , k] *a [k, j 1 ; 
a [ i / j ] : = sum; 
dum : = [i ) *abs (sum) ; 
if (dum > big) then begin 
big : = dum; 
imax : - i 

end 

end; 

if (j <> imax) then be.;.. 

for k : = 1 to n do begin 
dura : = a [ imax , k ] ; 
a [ imax , k ) : = a(j,k]; 

a [ j , k ) : = dum 
end; 

d ;= -d; 

w^(iraax) := w^tj) 

end; 

indx[j] imax; 

if (a[j,j) = 0.0) Then a[j,j) := tiny; 
if j <> n then begin 
dum : = 1 . 0/A E j , j ) ; 

for i j+1 to n do 
a(i,j) := a(i,j) *dum 

end; 

end; 

dispose ( w) ; 
end; 
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procedure lub)cab{var a: mat; n: integer; 

var indx: integerarraynp; 
var b: realarravnp ) ; 

var 

j , ip , ii , i : integex ; 

sum: real; 
begin 

ii := 0; 

f.or i 1 to n do begin 
ip : =s j ndx [ i ] ; 
sum : = b [ ip ] ; 
blip] : = b [i] ; 
if (ii <> 0) then 

for j := ii to i-1 do 

sum := sxijn-a [ i , j 3 *b ( j 3 
else if (s\im <> 0.0) Then 
ii := i; 
b [ i 3 J = sum 

end; 

for i :=5 n downto 1 du begin 
sum : = b[i3 ; 

for j := i+1 to n do 

sum := sum-ali, j J *b( j3 ; 
b ( i 3 •• = sum/ a ( i , i 3 

end 

end; 



procedure inverse (aa : mat ; var yy f mat r n : integer); 



var col : realarraynp; 

i,j . integer; 
begin 

ludcxrp (aa, n, indxx, dd) ; 
for j := 1 to n do begin 
for i : = 1 to n do col[i3 : 0.0; 

Coltj3 := 1.0; 

Lubksb ( aa , n , : ndxx , co 1 } ; 
for i:=ltondoyy(i,j3 := col[i3 
end; 
end; 

procedure matrixmul ( var c : mat ; a , b .mat ;m, p, n : integer ^ ; 

var i, j , )c : integer ; 

8 : real ; 

begin 

for i := 1 to m do 
begin 

for j:=l to n do 
begin 
s t=0; 

for k:=l to p do s:=:s + ati,3c3* b()c,j3; 
c (i, j J : =s; 
end; 
end; 
end; 

procedure cleanmat ( var x : mat ) ; 

var i , j : integer ; 

begin 

for i : = 1 to maxx do 
for j : = 1 to maxr. do 
xti.j3 := 0 ; 
end; 



function loglO ( x :real ) : real ; 



const vari = 0 . 4342944819032S2 ; (* ?./Ln(10) t= constant to •) 

(* transform to 10 log *) 

begin 

loglO := vari * ln(x) ; 
end; 

function funct( x : real ) : real ; 

begin 

funct:=: 1 / sqrt( 3.1415926535897932385 • 2) • Exp (-1 • (x) • (x) / 2 ) ; 
end; 




' 3 ^ 



procedure trapzd( a , b : real ; var e : real ; n : Integer ); 



var 

j : integer ; 

X , tmn , 8UJC , del : real ; 

begin 

if n s 1 then begin 

8 :=0,5* (B-a) * ( funct(a) + funct(b)); 
trapzdit := 1; 

end 

else begin 

tnm := trapzdit ; 
del :s { b - a ) /tnm ; 

X ;s a + 0.5 • Del ; 
sum : = 0.0 ; 

For j : s 1 to trapzdit do begin 
sum : = sum + funct ( x) ; 

X : = X + del? 

end; 

8 :=0.5* (S+ (b-a) • sum / tnm) ; 
trapzdit := 2 • trapzdit 

end 

end; 

procedure qtrap( a , b : real; var 8 : real ); 



label 99 ; 
const 

eps = l.OB-5 ; 
jmax = 20 ; 

var 

j : integer ; 
olds : real ; 

begin 

olds ;■ -l.OEiO ; 
for j :« I tc Imaz do begin 
trapzd ( a . b. m , j ) ; 

if abs ( 8 > olds ) < eps * ed:>s ( olds ) then goto 99; 
olds : m 8 

end; 

writeln( ‘pause in qtrap - too many steps'); 
readln; 

99 : 
end; 



function qlengte <q : queue) : integer; 
var k : kind ; 

i : integer ; 
begin 
i := 0 ; 
k := q''. Fir St ; 
while ( k <> nil ) do 
begin 

i : = i + 1 ; 
k := k^.Next ; 
end; 

qlengte := i ; 
end; 



BEST COPY AVAILABLE 



proc«dur« varuku jk ( q : q\ rA\a ) ; 

var multp : real ; 

i : integer ; 
k : kind ; 
stdev : real ; 
mean : real ; 

begin 

mean : s 0 ; 
atdev := 0 ; 
k := q^. First ; 
for i := 1 to q^. Length do 
begin 

mean := mean + k^.Ll[l]; 
stdev := stdev + k'^.Ll[l] * k^.Ll[l]; 

k := k'^.Next ; 
end; 

mean := mean / (q^. Length ); 
stdev := stdev - q^. Length * mean * mean; 
stdev := sqrt ( stdev / ( q^. Length - 1 )); 
if ( q^.Lichting = 0 ) then 
begin 

q^. School := q^. School + 1 ; 
q^.Lichting := 4 ; 

q^.Uk := gasdev( idvm ) * sqrt (0.1); 

Q^.Tj := trunc( ran3(idum) * 80 ) + 20 ; 
end; 

q^.Ujk := gasdev(idum) * sqrt (0.05); 

Multp := (q^.Uk + q^.Ujk) * stdev ; 
k := q^. First ; 
for i := 1 to q^. Length do 
begin 

k^.Ll(l) t= k^.Ll[ll + multp ; 
k ;= k^.Next ; 
end; 

q^.Lichting := q^.Lichting - 1 ; 
end; 

procedure nonsingulierxy ( var xx :mat ; hulp : rij ); 

var i , j , k : integer; 

begin 

for k := max •* 2 downto 1 do 
it ( abs(hulp(k) ) <0.000000001) Then 
begin 

for i := k to max-1 do 
XX [i] : =xx [i+1] ; 
end; 
end; 



procedure nonsingulier ( var xx :mat ; hulp : rij ); 
var i , j , k : integer ; 

begin 

for k : = max - 2 dovmto 1 do 
if ( abs(hulp[k]) <0.000000001 ) Then 
begin 

for i := 1 to max-l do 
for j := k to max-1 do 
xxti,j] := xx[i,j+l); 
for i := 1 to max-1 do 
for j := k to max-1 do 
xxl j,i] := xxt j+1, i) ; 

end; 

end; 
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procedure stMidardbeta. ( xx , xy : mat ; y2 ; real; hulp j rij ;up : integer )? 
var rxx, rxxl , rxy / stbet : mat ; 



begin 

for i := 1 to up do 
begin 

if ( abs (XX [i, i ] ) >0 . 0001 ) Then 

rxy(i,l] := xy[i,l]/ ( eqrt ( xx[i,i] • y2 ) )else rxy[i,l]:=0; 
for j := 1 to up do 

if (( abs (XX [ j , j ] ) >0 . 0001 ) And ( abs (xx [ i , i ]) >0 . 0001) ) Then 
rxx[i,j) := xx[i,j) / (sqrt ( xx[i,i) • xx[j,j) ) )else rxy[i,j]:=0; 
end; 

inverse(rxx, rxxi , up); 

matrixmul ( stbet , rxxi , rxy , up ,up , 1 ); write (beta,' ':10); 

j := 1 ; 

for i :s 1 to max - 1 do 

if (hulp[i) = 0 ) then write(beta,' ^:10) else 
begin 

write (beta, stbet [ j # 1) : 10 : 5 ) ; 

j := j + 1 ; 

end; 

write In (beta) ; 
end; 



procedure tijddistra( q : queue ); 
var i : integer ; 

k : )cind ; 
begin 

)c := q^. First ; 
for i:= 1 to q^. Length do 
begin 

)c^.Tij := q^.Tj; 

)c I = .Next; 
end; 
end; 

procedure tijddistrb( q : queue ); 

var nj : integer ; 
i : integer ; 
k : kind 

tauj , sj , devij , sigmatij : real ; 

begin 

k : = q^ .First ; 
nj := 0 ; 
sigmatij i= 0 ; 

sj 0 ; 

tauj : = 0 ; 

devij := 0 ; 

for i := 1 to q*. Length do 

begin 

if ( k^.Ll[l) < q^.Standaard ) then 
begin 

n j : = n j + 1 ; 

devij := devij + q^.Standaard - k^.Ll[l) 
end; 

k : = k^ .Next ; 
end; 

sigmatij := q*. Length * q^.Tj - q^. Length * If , 
sj := sigmatij / nj ; 
devij := devij / nj ; 
tauj := sj / devij ; 

k := q'^ .First; 
for i := 1 to q*. Length do 
begin 

if ( k^.Ll[l] < q^.Standaard ) then 
k^.Tij tauj * ( q^.Standaard - k^.Ll[l] ) + 10 

else 

k'^.Tij ;= 10; 
k := k'^.Next; 
end; 



i,j J integer ; 



end 
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procedure tljddlstrcl q : qu«ue ); 



var nj : Integer ; 
i : integer ; 
k : kind 

laag^aes , hoog_sea integer ; 

tauj , aj , devij , aigmatij , taulj , tau2j : real ; 

begin 

k := q*'. First; 
n j : = 0 ; 
aigmatij := 0 ; 
sj := 0 ; 

tauj :s 0 ; 

devij := 0 ; 
laag_8ea :s 0 ; 
hoog_ses : = 0 ; 
for i := 1 to q^. Length do 
begin 

if ( k''.Ll[l] < q'' . Standaard ) then 
begin 

if { k‘'.Ll[2] s 1 ) then laag^ses := laag^ses + 1 else 

hoog^ses : = hoog_8es + 1 ; 

nj := nj + 1; 

devij := devij + q^.Standaard - k*.Ll[l] 
end; 

k : = k'' .Next ; 
end; 

aigmatij := q*'. Length * q'^.Tj - q*. Length * 10 ; 
sj := sigmatij / nj ; 
devij : = devij / nj ; 
tauj := sj / devij ; 

taulj := tauj • nj / ( 2 * laag_8es + hoog_ses ); 
tau2j := taulj * 2; 
k : q* .First; 

for i : = 1 to q*' . Length do 
begin 

if ({ k^.LlCl] < q^.Standaard) and ( k*.Ll[2] = 1 ) ) 
k'^.Tij := tau2j * ( q*' . Standaard - k-'.LlCl] ) + 10 
else 

if (( k‘^.Ll[l] < q'^ . Standaard) and ( k‘'.Ll[2] = 0 ) ) 
k'^.Tij := taulj * ( q'^ . Standaard - k‘'.Ll[lJ ) 4 10 
else 

k^.Tij := 10; 
k := k-'.Next; 
end; 
end; 
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then 

then 



procedure residuals ( qq : queue )/ 

var xy , xx , h , r , ht , ma: mat; (* henk.Tpu array I 1 . . 5 , 1 . . 5] Of real *) 
regel , hulp t ri j ; 

1 / j / k : Integer ; 

Inter : real / 
typ,n t integer; 
q : kind ; 
y2 , yp : real ; 
missing : Integer; 
begin 

n:= qq*. Length ; 
q qq*. First ; 
cleanmat (xy) ; 
cleanmat (xx) ; 
cleanmat (r ) ; 
cleanmat (h) ; 

(* calculation of residuals using regression analysis 
first we calculate a sscp-matrix: x'x = x'x - xm'xm, 

in which xm = matrix with mean scores. 

For technical reasons this is reformulated as x ' x ~ n * xi * xj . 

(Xi and xj are the mean scores for var 1 and j; n = # 
of cases. 

We do not need the transpose of xm and so we avoid large matrices. 

As a reference for this procedure see: Tatsuoka (1971) p. 30 . 

First of all in calculating the sscp-matrix both y- and x- variables 
are involved. In a next step the matrices spp en spc are constructed. 
Once the inverse of spp is found, the beta-weights and intercept can be 
readily deduced. 

*) 

For i := 1 to max do regel [i]:=0; 

(* means and sum of squares and sum of crossproducts *) 
for i 1 to n do 
begin 

for j : = 1 to max do 

regel [j] := regellj] + q*.Ll[j] ; 

for j : s 1 to max do 
for k := 1 to max do 

xxlj,k) xx[j,k] + q*.Ll[j] * q*.Ll[k]; 
q : = q* .Next; 
end; 

( * means * ) 

for i 1 = 1 to max do 
regel[i]:= regel[i]/n / 

(* sum of sqpiares etc. In the form of deviations *) 
for j:= 1 to max do 
for k:= 1 to max do 

xx[j,k) := xx[j,k) - n * regel [k] * regel[j]; 

y2 := xx[l,l); 

(* matrices spp and spc *) 
for i : = 2 to max do 
xy(i-l,l) := xx[i,l); 
for i 1 to max-1 do 
for j : = 1 to roax-1 do 
biigln 

h(i, j ) := xx[i+l, j+1) ; 

ma[i, j ) := h(i, j ) / 

end; 

qq*.Stdev := sqrt ( xx[l,l] / ( n - 1 ) ); 

cleanmat (xx) ; 

(* avoid singular matrices because we want to calculate the inverse *) 
for i := 1 to max do hulp(l] :=0; 
missing := 0 ; 

for i : = 1 to max-1 do 
for j : = 1 to max-1 do 
hulp[j) := hulp[j] + h[i,j); 
for i : = 1 to max-1 do 

if (abs (hulp [i] ) <= 0.000000001 ) Then missing := missing + 1 ; 

if (missing > 0 ) then 

begin 

nonsingulier ( ma , hulp ) ; 
nonsinguller ( h , hulp ); 
nonsingulierxy ( xy , hulp); 
end; 



(* inverse of *pp *) 
lnv«r«« (h, XX, m«x “I -missing) ; 
clsazunat (h) ; 

(* invsrss spp * spc s bsta *) 

matrixraul (h,xx, xy, max-i-missing, max-l-missing, 1) ; 

(* sstimats the intercept *) 
inter :s regel [1] ; 

j := 1 ; 

for i : = 1 to max-1 do if ( hulp[i) <> 0 ) then 
begin 

inter s= inter - h[j,l) * regel[i+l); 

j := j + 1 ; 

end; 

write (beta, inter: 10:5); 
j := 1 ; 

for i : = 1 to max - 1 do 
if i h«lp[i) <> 0 ) then 
begin 

writ© (beta,h[ j,, 1) :^0r 5) ; 

j := j + 1 ; 

end 

else write (beta, ' ':10); 

j := 1 ; 

cleanmat ( ht ) ;• 

for i:= t'b iftax-1- missing do 
htd.-ij' := hii,H ; 

c:ac r ixKiu 1( r , ht , xy , 1 , max - 1 -mi a s i ng , 1 ) ; 
write In (beta, ' ',l/y2 * r[l,l) :4;2); 

standardbeta (ma, xy , y2 , hulp,max- 1 -mis sing) ; 
q := qq^. First ; 

(* estimation of residuals *) 

for j : = 1 to n do 

begin 

yp : - inter ; 
for i : = 2 to max do 
yp := yp + q^.Ll[i) * h[i-l,lj; 
q*^.Resid := q'^.Ll[l) - yp; 
q : = q^ . Next ; 
end; 

qq^ . Standaard := regel [1] +0.5 • Qq*.Stdev ; 
qq^ .Oemiddelde i= regel [1]; 

typ := qq^.Bljr div 10; 

if ( (expno = 1 ) and ( { t^q> <* l ) or ( t>*p = 2 ) ) ) then 
begin 

case typ of 

1 : qq'^ . Scandaard := qq^ . Gemiddeldci ♦ 0.7 5 * Qq^.Stdev; 

2 : qq^ . Standaard := qq%. Gemiddeld*; ♦ 0.60 * Qq^.Stdev; 

ond; I 

end; t 

f 

gemiddeldon [qq^ .Blj r di'^- 10 , qq'^ . El j r mod 10 J : = 
gemiddelden [qq^ .Elir dxv 10,qq*.Eljr tfvod 10 J + 1; 
end; 



function initkind : )tind ; 

var i *. iiitoger ; 

)t : Kind ; 

begin 
new ( k ) ; 

for i : = 1 to max do k'^.^jlii) := 0 ; 
k^.Eljr := 0 ; 
k-' .Typ : = 0 ; 
k^.Ljr ;= 3 ; 
k'^.Resid : = 0 ; 
k^.Next := nil : 
k^.Doubleer :s false; 
k^.Merkteken ts false; 
k^.Leerjaren := 1 ; 
k^.Nummer := teller; 
teller :s teller 4 1; 
k^.Tij := 0; 
initkind >= k ; 
end; 
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procedure inqueue ( hhqueue : queue ; eenkind : kind ) ; 
begin 

eenkind* . Next :z nil ; 

if (hhqueue* .First s nil ) then 

begin 

hhqueue* .First : = eenkind ; 
hhqueue* . Last eenkind ; 

end 
else 
begin 

hhqueue* . Last *. Next :s eenkind; 
hhqueue* . Last : s eenkind ; 
end; 

hhqueue* . Length :s hhqueue* . Length 1 ; 
end; 



procedure vulklas ( tqueue : queue ; hqueue : queue ; var i 
typjaar : integer }; 

var ditkind , vorigkind : kind ; 

er , gevonden : integer; 

ch : char ; 

begin 

gevonden : i ; 

ditkind := hqueue* . First ; 

vorigkind := hqueue* .First ; 

while ( ( ditkind <> nil } and ( i > 0 ) ) do 

begin 

er := ditkind* .Bljr ; 

while ( ( ditkind <> nil ) and ( er <> typjaar )) do 
begin 

vorigkind := ditkind ; 
ditkind := ditkind* .Next ; 

if ( ditkind <> nil ) then er := ditkind* . Elj r ; 
end; 

if ( ditkind <> nil ) then 
begin 

i := i - 1 ; hqueue* . Length hqueue* . Length - 1 ; 
if ( ditkind s hqueue* . First ) then 
I -gin 

hqueue* . First ditkind* . Next ; 
vorigkind ;= hqueue* . First ; 
inqueue (tqueue, ditkind }; 
ditkind := hqueue* .First ; 
end 

else if (ditkind = hqueue*. Last ) then 
begin 

vorigkind* .Next := nil ; 
hqueue*. Last := vorigkind; 
inqueue (tqueue, ditkind) ; 
ditkind := nil ; 
end 
else 
begin 

vorigkind* .Next i= ditkind* . Next ; 
inqueue ( tqueue , ditkind ) ; 
ditkind := vorigkind* . Next ; 
end; 
end; 
end; 
end; 

function leeskind( k : kind } : kind ; 

var i : integer ; 

begin 

for i 1 to max do read ( inf ile, k* . LI I i } ) ; 
regels : = regels <f 1 ; 



+ 1 ; 



G i 

BEST COPY AVAILABLE 



readln ( infile , k* . Typ) ; 
k*.aanvang k*.typ; 
K*.Eljr 1 = k*.Typ * 10 
k*.Nep false ; 
k*.Svtoud k*. Lit 11; 
leeskind k ; 
end; 



: integer 
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procedure loopbaan ( p :kiiid ; i : integer ); 



var hl,b2 : Integer ; 
begin 

h2 := p'^.Eljr mod 10 ; 
hi := p'^.Bljr div 10 ; 
if ( p'^.Typ < maxi ) then 
begin 
case i of 



true ; 

p^.Leerjaren + 1 
) then 



begin 

p'' .Merkteken 
. Leer jaren 
if ( p^'-Doubleer = true 
begin 

p^'-Doubleer := false ; 
if ( hi > 1 ) then 
p^.Bljr := (hi - 1 ) 
p-'.Typ := p'^.Typ * 10 ^ 
p^'.Ljr := p^'.Ljr * 10 ^ 
end 
else 
begin 

p^.Doubleer := true 



10 



h2 



p'' . Typ 
.Ljr 

end 
end; 
begin 
p^.Typ : 
p^ .Ljr 



p 

:= p 



.Typ 

'.Ljr 



10 

10 



hi 

h2 



hi 

h2 



- 1 



p^ . Leer jaren 
p^ . Bljr 
end; 

if ( hi 
begin 
p'' . Typ 
.Ljr 
p'.Bljr 



= p'^.Typ * 10 + hi; 

= p^ .Ljr * 10 + h2 + 1 
p^ . Leer jaren 
= p^ .Bljr + 1 ; 



10 + 1 



< 4 ) then 



hi 

h2; 

10 



+ 1 ; 



+ 1 



p-'.Typ * 10 

p^.Ljr * 10 

( hi + 1 ) * 10 + h2; 
p^. Leer jaren : = p^. Leer jaren * 10 
end 
else 
begin 

p^.Typ := p^.Typ * 10 + hi; 

p'^.Ljr := p'^.Ljr * 10 + h2 + 1; 

p^.Eljr := p^.Bljr + 1; 
p*' . Leer jaren := p*^ . Leer jaren *10 + 1 
end; 



. Bljr : s p^ .Bljr + 1 



end; 

end else 
end; 

procedure freecjueue ( var q 
var kl , k2 : kind ; 
begin 

kl := q^. First; 
k2 := kl^.Next; 
while ( k2 <> nil ) do 
begin 

dispose (kl) ; 
kl k2 ; 
k2 : = k2 ^ . Next ; 
end; 

dispose (kl) ; 
with q'^ do 
begin 

length := 0; 
stdev := 0; 
gemiddelde 
standaard 
el j r 



queue ) ; 



first 
last 
end; 
end; 



= 0 ; 

= 0 ; 

= 0 ; 

= nil 
= nil 
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procedure schoolwitsel ( var )C/ hulp : kind ; dazerij .wachtrij : queue ) 
begin 

dezerij Length :s dezerij ^ . L<*ngth - 1 ; 
if ( k = dezerij * .First ) then 
begin 

dezerij .First := k^.Next; 
inqueuo( wachtrij , k ); 
k := dezerij * .First; 
hulp := dezerij * .First ; 
end 

else if ( k = dezeri j * . Last ) then 
begin 

hulp Next := nil ; 
dezerij . Last := hulp; 
inqueue (wachtrij , k ) ; 
k := nil ; 
end 
else 
begin 

hulp Next := k^.Next ; 
inqueue (wachtrij , k ); 
k : = hulp^.Next; 
end; 
end; 
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procedure process ( q : queue ; serleus : integer ) ; 



(* this procedure uses for the pc-verslon an external in henk.tpu 

defined procedure called qtrap. For more detailed information see: 
numerical recipes in pascal: integration of functions, p. 126. 

This routine accomplishes that the learning gain is inversely 
proportional to the distance to the standard. Qtrap produces a 
value between 0 and 1. This value is multiplied with a random 
digit chosen between 0 and 2 times the standard deviation of 
achievement in a class . The result is added to the achievement . 

This calculation is only used for pupils with negative residuals, 
being underachievers . The other p^CTpils (overachievers) have a chance 
on gain in achievement of 0.5 * Random digit chosen between 0 and 1 
standarddevlation of achievement and a chance of 0.5 on ma)cing no 
progress 

•) 

var hq : queue ; 

k , hulp: kind ; 
i : integer ; 

fractie , leerwinst : real i 
standaard : array [1.. 3] Of real ; 
optimum : realarraynp; 



for i : = 1 to 3 do 
standaard [i] q^. Standaard ; 

(* initersect ion as the equilibrium between marginal costs and benefit 
specified for three SBS groups seperately ; THIS IS AN OPTION *) 
opt imum [ 1 ) : = 0 ; 

optimum [2] ;= 0 ; (• (q^ . Standaard - q^ .Gomiddelde) /2; •) 
opt imum [3) ;= 0 ; (• (q^ . Standaard - q'^ . Gemiddelde ) ; * ) 

(* standard can be differentiated between three groups of pupils; 
in this setup we only use one standard 

n.b. three standards for low [1], medium [2] and high [3] SBS pupil 
(• if ( serieus = 0 ) then hq := hulpqueuo 
else hq := zitqueue ; *) 

case expno of 

0 : ti jddistra (q) ; 

1 : tijddistra(q) ; 

2 ; t i jddistrb (q) ; 

3 : ti jddistrc (q) ; 
end; 

k := q^. First ; 
for i : = 1 to q^. Length do 
begin 

(• was if ( k^.Resid < 0 ) then •) 
if (k^. Res id < opt imum[ trunc ( k^ . Ll [2 1 ) ) ) then 
begin 

qtrap ( ( k'‘.Ll[l) - q'^ . Oemiddelde )/q''.Stdev , 

(optimum [trunc (k^ . Ll [2 )))) /q^ . Stdev , fractie ) ; 

fractie :«(!*■ fractie ) ; 

k*.Ll[l) := k^.Lltl) + fractie * loglO (k^ .Ti j ) /loglO (55) 

(• • ran3 ( idum) *) • ( trunc ( q^.Stdev ) ) ; 

end 
else 

k^.Ll[l) := )c^.Ll[l) + Iogl0(k^.7ij)/logl0(55) * 

ran3(idum) * ( trunc ( q^.Stdev ) ) *■ 0 . 5 * Q^.Stdev; 
k : = k'^ .Next ; 
end; 

residuals (q) ; 
hulp := q'^. First ; 
k := q^. First ; 
for i:= 1 to q^. Length do 
begin 

if ( k^.Nep = false) then hq := zitqueue 
else hq := hulpqueuo ; 

if ( (k'^.LltD) < (standaardil) - 0.99 * Q^.Stdev ) ) then 
begin 

loopbaan ( k , 0 ) ; 

zittenbli jvers := zittenbli jvers + 1 ; 
schoolwissel ( k , hulp , q , hq ) ; 
end 
else 

if ( (q^.Kljr div 10 < 4 ) and (k^.Ll[l) > 

(q^ .Oemiddelde 2 * q^.Stdev))) then 
(• ( gemiddelden[ (q^ .Bljr div 10) + 1 ,q^.Rljr mod 10 ) ) ) ) tl en 



begin 




BESTCOFWmiU 



begin 

loopbe^in ( k , 2 ) ; 
schoolwieeel ( k , hulp , q , hq ) ; 
end 

else 

begin 

loopbean { k , 1 ) ; 

hulp : = k ; 
k := k^.Noxt ; 
end; 
end; 

q^.Bljr := q^.Kljr -i- 1 ; 
if ( q^. Length < 35) then 
begin 

i := round ( rem3 ( idum) * 10 ); 
if ( serieus = 0 ) then 
vulklas( q , hq , i , q^.Bljr ) 
else 
begiu 

vulklas( q , zitqueue , i , q^.Eljr ); 
if ( i > 0 ) then 

vulklas{ q , hulpqueue , i , q^.Bljr ) 
erd; 
end; 

end; 

procedure schrijfweg{ q : queue ); 

var k : kind ; 

i : integer ; 
begin 

k := q^. First ; 

while { k <> nil ) do 

begin 

if ( k'^.Nep = false ) then 
begin 

while { k^.Typ > maxi ) do 
begin 

k^.Typ := k^.Typ div 10 ; 
k^'.Ljr := k^.Ljr div 10 ; 
end; 

write (outfile,q* . school : 4 , q^ . lichting : 1 .Nummer : 5 ) ; 
write (out file, k* . aanvang : 4 , .Eljr : 4 ) ; 
for i := 1 to max do 
write (outfile,k*. LI [i] :10:3); 
write (outfile,k'‘ . Typ : 10) ; 

writeln(outf ile ,k'‘ . Svtoud: 10 : 3 , k^ . Lj r : 10 , k* . Leer j aren : 10 ) 
end; 

k : = k , Next ; 
end; 
end; 



b 4 
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procedure ververkfile ( serieue : integer ); 
var k ; kind ; 

i / h , r : integer ; 
somequeue : <^eue ; 
kladvar : integer; 

begin 

r := 25 + round ( ran3 ( idum) * 5); (* class size between 25 and 30 pupils *) 

while not eof (infile) do 
begin 

k := iritkind ; 
k := leQskind(k); 

if ( ( serieus = 0 ) or ( serieus 2 ) ) then 
k-^.Nep :s: true else begin echt : =echt+l ; k-^ . Nep := false ; end; 

case k^.Typ of 

1 : inqueue ( queue Ibo ,k) ; 

2 : inqueue (queu etna VO ,k); 

3 : inqueue ( queue havo ,k); 

4 : inqueue (queuevifo ,k); 
end; 

somequeue : = nil ; 

if ( queue Ibo ^ . Lengt n >= r ) then begin somequeue := queuelbo; 
somequeue^ .Bljr := 11 end 
else 

if ( queuemavo ^ . Length > = r ) then begin soznequeue := queuemavo; 
somequeue^ . Blj r :s 21 end 
else 

if (queuehavo^ . Length > = r ) then begin somequeue ; - queuehavo ; 

somequeue'*- . Kljr :=31 end 
else 

if ( queuevwo^ . Length >= r ) then begin somequeue ; = queuevwo; 
somequeue ^ . Blj r := 41 end; 
if ( somequeue <> nil ) then 
begin 

(* a small adjustement to enter pupils repeating the first grade •) 
i := 10 ; (• round ( ran3 ( idum) • 10 ) ; •) 

if ( serieus = 0 ) then 

vulklas ( somequeue ,hulpqueue, i , somequeue^ . Klj r ) 
else 
begin 

vulklas ( somequeue , zitqueue , i , somequeue^ .Bljr ); 
if ( i > 0 ) then 

vulklas ( somequeue , hulpqueue , i , somequeue^ . Blj r ) 
end; 

(• end of adjustment; for the pc-version this part has to be MODIFIED •) 
varukujk( somequeue ) ; 
residuals ( somequeue ); 

process ( someqpieue , serieus ); 
for h ;=1 to 3 do 
process ( somequeue , serieus ) ; 

( * if ( serieus = 1 ) then * ) 
schrijfweg( somequeue ); 
freequeue( somequeue ); 
r := 25 + round ( ran3(idum) • 5); 
end; 
end; 
end; 

procedure initqueue ( q : queue ) ; 

begin 

with q^ do 
begin 

school := 0 ; 
lichting := 4 ; 

uk : = gasdev(idum) • sqrt(O.l); 

Length := 0 ; 
stdev : = 0 ; 
standaard : 0 ; 

first := nil ; 
last nil ; 

eljr := 0 ; 

tj := trunc(ran3 (idum) * 80 ) ♦ 20 ; 
end; 
end; 

66 

o 

ERIC 



65 



writeln ( ' 
wrlteln ( ' 
writeln ( ‘ 
writeln ( ' 



begin (* main program *) 

writeln(' which experiment do you want to conduct? (0..3)?'); 

0 = the present situation (unchanged policy) ' ) ; 

1 s: higher standards in Ibo ^Uld mavo ' ) ; 

2 = unequal instruction time ' ) ; 

3 = as with 2 but with extra time for low SBS pupils '); 

readln(expno) ; 

for i := 1 to 4 do 

for j := 1 to 4 do gemiddeldenti, j 1 := 0; 

gasdeviset 0 ; 
regels := 0 ; 
teller := 1 ; 
totaal := 0 ; 
schnr := 0 ; 
echt : = 0 ; 
zittenbli jvers := 0 ; 

(* the variable idum takes care of the random saunpling of pupils from the file 
infile.dat; by changing idum we will saunple other pupils •) 
idum := 15000; 

idum := -1 * idum ; 

Reset (inf ile) ; 
rewrite (out file) ; 
rewrite (beta) ; 
new(hulpqueue) ; 
initqueue (hulpqueue ) ; 
new(zitqueue) ; 
initqueue (zitqueue ) ; 
new (queue Ibo) ; 
initqueue (queue Ibo ) ; 
queue Ibo* . School := 1000 ; 
new (queuemavo ) ; 

initqueue(queuemavo) ; 
cfueuemavo* . School t = 2 000 ; 
new ( queuehavo ) ; 

initqueue (queuehavo ) ; 
queuehavo* . School :« 3000 ; 
new (queuevwo) ; 
initqueue (queue wo ) ; 
queuewo* . School :■ 4000 ; 
verwerkfile( 0 ); 
reset (inf ilei : 
verwerkfile( 1 ); 
reset ( inf 1 le i ; 
verwerkflle( 2 ): 
writeln; wr it eln; 
for i :• I to 4 do 
begin 

for j : « 1 to 4 do 
write ( gemiddelden [ i « j ] : 10 : 4 ) ; 
writeln; 
end; 

writeln(' lengte wachtrij 
writeln( ' zittenbli jvers 
writeln(' het totale legioen 
writeln(' zitqueue 




’ , qlengte (hulpqueue) : 10) ; 
' , zittenbli jvers : 10) ; 

' , teller : 10 ) ; 

' , qlengte (zitqueue) : 10 ) ; 



writeln; writeln ( • s = =: = = ========== = =====ss=:== ==sss= 






writeln;writeln( ' echte cases 
writeln( 'hulpqueue 
writeln ( 'zitqueue 
writeln{ 'queuelbo 
writeln ( 'queuelbo'^ .Length 
writeln ( 'queuemavo 
writeln ( * queuemavo'^ . Length 
writeln ( 'queuehavo 
write In ( ' queuehavo'^ . Length 
write In ( 'queuevwo 
writeln ( 'queuevwo'^ .Length 



, echt : 10 ) ; 

' , tellen( hulpqueue) : 10 ) ; 
' , tellen( zitqueue) i 10) ; 

' , tellen (queuelbo) : 10 ) ; 

# queuelbo'^ . Length : 10 ) ; 

' , tellen(queuemavo) : 10 ) ; 
' 0 q:ieuemavo'^ . Length : 10 ) ; 
' , tellen (queuehavo) ; 10 ) ; 
' 0 queuehavo'^ . Length: 10 ) ; 
' 0 tellen(queuevwo) ; 10) ; 

' , queuevwo^ . Length 1 10 ) ; 



wiedan ( zitqueue ) ; 

{ * the last line is an option to ma)ce sure that we write remaining pupils 
schrijfweg( zitqueue) ; 

usei to warm up the system; we are not interested, however, in these 
pupils *) 

End. 
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